Mobile battery energy storage system control with knowledge‐assisted deep reinforcement learning
نویسندگان
چکیده
Most mobile battery energy storage systems (MBESSs) are designed to enhance power system resilience and provide ancillary service for the operator using storage. As penetration of renewable fluctuation electricity price increase in system, demand-side commercial entities can be more profitable utilizing mobility flexibility MBESSs compared stational system. The profit is closely related spatiotemporal decision model influenced by environmental uncertainties, such as traffic conditions. However, solving real-time control problem considering long-term uncertainties time-consuming. To address this problem, paper proposes a deep reinforcement learning framework maximize through market arbitrage. A knowledge-assisted double Q network (KA-DDQN) algorithm proposed based on learn optimal policy efficiency. Moreover, two criteria action generation methods integer actions scheduling short-term programming results. Simulation results show that method achieve result, KA-DDQN accelerate process original approximately 30%.
منابع مشابه
Modeling and Efficient Control of Microturbine Generation System With Battery Energy Storage for Sensitive Loads
Microturbine generation system is one of the most promising and a fast growing distributed generation sources. It is used in various applications thanks to high efficiency, quick start and high reliability. Combination of the microturbine and storage system (e.g. battery bank) is desirable selection to satisfy the load requirements under all conditions and hence the battery bank can play an imp...
متن کاملReinforcement Learning with Deep Energy-Based Policies
We propose a method for learning expressive energy-based policies for continuous states and actions, which has been feasible only in tabular domains before. We apply our method to learning maximum entropy policies, resulting into a new algorithm, called soft Q-learning, that expresses the optimal policy via a Boltzmann distribution. We use the recently proposed amortized Stein variational gradi...
متن کاملReinforcement Learning Based PID Control of Wind Energy Conversion Systems
In this paper an adaptive PID controller for Wind Energy Conversion Systems (WECS) has been developed. Theadaptation technique applied to this controller is based on Reinforcement Learning (RL) theory. Nonlinearcharacteristics of wind variations as plant input, wind turbine structure and generator operational behaviordemand for high quality adaptive controller to ensure both robust stability an...
متن کاملContinuous control with deep reinforcement learning
We adapt the ideas underlying the success of Deep Q-Learning to the continuous action domain. We present an actor-critic, model-free algorithm based on the deterministic policy gradient that can operate over continuous action spaces. Using the same learning algorithm, network architecture and hyper-parameters, our algorithm robustly solves more than 20 simulated physics tasks, including classic...
متن کاملOptimal Threshold Control for Energy Arbitrage with Degradable Battery Storage
Energy arbitrage has the potential to make electric grids more efficient and reliable. Batteries hold great promise for energy storage in arbitrage but can degrade rapidly with use. In this paper, we analyze the impact of storage degradation on the structure of optimal policies in energy arbitrage. We derive properties of the battery degradation response that are sufficient for the existence of...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: Energy conversion and economics
سال: 2022
ISSN: ['2634-1581']
DOI: https://doi.org/10.1049/enc2.12075